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Accepted  24  November  2014  formation,  beyond  routine  vital  signs,  for  making  a  specific  clinical  assessment:  identification  of  hemorrhaging 

patients  who  receive  packed  red  blood  cell  (PRBC)  transfusion. 

Methods:  Adult  prehospital  trauma  patients  were  analyzed  retrospectively,  excluding  those  who  lacked  a  com¬ 
plete  set  of  reliable  vital  signs  and  a  clean  electrocardiogram  for  computation  of  HRV  metrics.  We  also  excluded 
patients  who  did  not  survive  to  admission.  The  primary  outcome  was  hemorrhagic  injury  plus  different  PRBC 
transfusion  volumes.  We  performed  multivariate  regression  analysis  using  HRV  metrics  and  routine  vital  signs 
to  test  the  hypothesis  that  HRV  metrics  could  improve  the  diagnosis  of  hemorrhagic  injury  plus  PRBC  transfusion 
vs  routine  vital  signs  alone. 

Results:  As  univariate  predictors,  HRV  metrics  in  a  data  set  of  402  subjects  had  comparable  areas  under  receiver 
operating  characteristic  curves  compared  with  routine  vital  signs.  In  multivariate  regression  models  containing 
routine  vital  signs,  HRV  parameters  were  significant  (P<  .05)  but  yielded  areas  under  receiver  operating  charac¬ 
teristic  curves  with  minimal,  nonsignificant  improvements  (  +  0.00  to  +0.05). 

Conclusions:  A  novel  diagnostic  test  should  improve  diagnostic  thinking  and  allow  for  better  decision  making  in  a 
significant  fraction  of  cases.  Our  findings  do  not  support  that  HRV  metrics  add  value  over  routine  vital  signs  in 
terms  of  prehospital  identification  of  hemorrhaging  patients  who  receive  PRBC  transfusion. 
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1.  Introduction 

A  series  of  investigations  have  suggested  that  measures  of  heart  rate 
variability  (HRV)  offer  a  promising  capability  for  the  identification  of 
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trauma  patients  who  require  life-saving  interventions  (LSIs),  which 
are  time-sensitive  clinical  interventions,  such  as  packed  red  blood  cell 
(PRBC)  transfusion,  endotracheal  intubation,  and  operative  interven¬ 
tions.  Heart  rate  variability,  which  can  be  measured  via  routine  electro¬ 
cardiography,  represents  the  beat-to-beat  fluctuations  in  the  R-R 
intervals  (RRIs)  of  the  electrocardiogram  (ECG),  revealing  the  state  of 
the  patient's  autonomic  nervous  system.  A  wide  range  of  different 
HRV  metrics  have  been  investigated  [1],  including  frequency  domain 
metrics  [2-7],  time  domain  metrics  [2,3,5-11  j,  and  complexity  metrics 
[2-4,6,8,10,12], 

In  trauma  patients,  it  is  clear  that,  on  average,  those  patients  who 
subsequently  require  an  LSI  have  reduced  HRV  during  prehospital  and 
emergency  department  (ED)  monitoring  [4,6,8,12],  There  are  also  sig¬ 
nificant  differences  in  HRV  group  averages  between  trauma  patients 
with  and  without  traumatic  brain  injury  [7,11  ]  and  between  survivors 
vs  fatalities  [2, 3, 5,7].  Moreover,  diagnostic  test  characteristics  have 
been  encouraging,  with  80%  sensitivity  and  75%  specificity  reported  in 
patients  who  require  surgical  intervention  in  the  operating  room  [9] 
and  86%  sensitivity  with  74%  specificity  reported  in  patients  who 
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require  any  LSI  [10],  However,  these  findings  are  tempered  by  several 
other  reports,  which  suggest  that,  for  that  subset  of  trauma  patients 
with  normal  vital  signs,  HRV  metrics  have  a  low  sensitivity  (16%)  for 
LSI  prediction  [6],  and  their  diagnostic  potential  is  reduced  by  notable 
intersubject  variability  as  well  as  intrasubject  temporal  variability  [13], 
To  date,  HRV  monitoring  has  not  become  routine  practice,  although 
PubMed  lists  more  than  1 0  000  citations  relevant  to  HRV  from  over  3 
decades,  spanning  a  diversity  of  potential  clinical  applications.  This 
suggests  that  there  may  be  some  barrier  (eg,  economic,  regulatory, 
educational,  etc)  that  is  hampering  the  dissemination  of  a  potentially 
useful  technology.  Alternatively,  it  may  be  that  the  aforementioned 
research  studies  have  been  suboptimal  in  terms  of  answering  precisely 
how  (or  if)  HRV  can  improve  patient  care.  Many  of  the  published 
reports  about  HRV  offer  intriguing  associations  but  do  not  provide 
explicit  comparisons  vs  the  routine  clinical  data  used  in  standard  deci¬ 
sion  making.  For  instance,  if  HRV  is  to  be  used  in  deciding  whether  a  trau¬ 
ma  patient  requires  trauma  center  care,  it  may  be  elucidating  to  compare 
it  against  standard  criteria  for  trauma  center  transport  [14].  Likewise,  if 


HRV  is  to  be  used  for  diagnosing  traumatic  brain  injury,  it  could  be  com¬ 
pared  against  standard  criteria  for  neuroimaging  after  head  injury,  for 
example,  the  Canadian  head  computed  tomography  rule  [15]. 

To  better  understand  the  value  of  HRV  for  decision  making,  we  de¬ 
cided  to  focus  on  the  identification  of  trauma  patients  with  major  hem¬ 
orrhage  who  receive  PRBC  transfusion  because  exsanguination  is  a 
leading  cause  of  death  in  both  civilian  [16]  and  military  [17]  trauma 
populations,  whereas  many  hemorrhagic  deaths  can  be  prevented 
with  time-sensitive  interventions  such  as  surgeiy  and  optimal  resusci¬ 
tation  [18,19].  In  theory,  a  reliable  and  simple  diagnostic  indicator  of 
which  patients  require  such  interventions  could  enhance  the  quality 
and  efficiency  of  clinical  decision  making,  leading  to  optimal  patient 
outcomes.  Fig.  1  illustrates  2  cases  in  which  the  patients'  vital  signs 
are  similar,  but  HRV  metrics  indicate  whether  or  not  the  patients  are 
suffering  life-threatening  hemorrhage. 

To  this  end,  we  conducted  a  multivariate  analysis,  using  routine  vital 
signs  as  the  comparator,  to  test  the  hypothesis  that  HRV  metrics  can  im¬ 
prove  the  identification  of  patients  with  major  hemorrhage.  By  focusing 
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Time  (s)  Time  (s) 


Subject  characteristics 

Normal  range 

HRV  metrics 

RSA  (cpm):  23 

19-26 

SDNN(ms):  37.15 

23-53 

SampEn:  0.48 

0.9- 1.4 

Vital  signs 

HR  (bpm):  77 

77-105 

SBP(mmHg):  100 

120-147 

Injury  description:  Grade  II  liver  laceration.  Grade  IV 
spleen  laceration 

24-hr  PRBC  volume:  1 3 


Subject  characteristics  Normal  range 

HRV  metrics 


RSA  (cpm):  18.68 

19-26 

SDNN  (ms):  51.88 

23-53 

SampEn:  1.51 

0.9- 1.4 

Vital  signs 

HR  (bpm):  66 

77-105 

SBP  (mmHg):  99 
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Injury  description:  Superficial  spleen  laceration, 
thoracic  cavity  injury  with  hemo-  and  pneumo-thorax 

24-hr  PRBC  volume:  0 


Fig.  l.The  2  cases— 30-second  excerpts  of  ECG,  HR,  and  RR1  waveforms  from  2  different  subjects— are  selected  examples  where  HRV  metrics,  but  not  routine  vital  signs,  can  differentiate 
between  patients  with  (left)  and  without  (right)  hemorrhagic  injuries  requiring  substantial  24-hour  PRBC  transfusion.  For  each  subject,  the  RRI  waveform  is  illustrated,  along  with  each 
cycle  of  sinus  arrhythmia  that  was  identified  by  computer  algorithm  (each  cycle  indicated  by  numerals  above  the  RRI  waveform);  see  text  for  more  details  about  computation  of  HRV 
metrics.  The  “normal  ranges"  listed  in  the  tables  above  represent  the  interquartile  range  for  subjects  who  did  not  receive  any  24-hour  PRBC  transfusion. 
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on  a  specific  clinical  condition  of  clear  importance,  that  is,  substantial 
hemorrhage  after  injury,  and  quantitatively  comparing  HRV  metrics  vs 
routine  vital  signs  as  diagnostic  tests,  it  may  be  possible  to  better  under¬ 
stand  if  and  how  HRV  metrics  may  be  used  to  improve  trauma  patient 
management. 

2.  Materials  and  methods 

2.J.  Clinical  data  collection 

We  examined  2  pooled  datasets,  the  first  originally  collected  on 
board  Memorial  Hermann  Life  Flight  (MHLF,  Houston,  TX)  air  ambu¬ 
lances  [5,20]  between  August  2001  and  April  2004  and  the  second 
from  Boston  Medflight  (BMF,  Bedford,  MA)  air  ambulances  between 
February  2010  and  December  2012  with  institutional  review  board  ap¬ 
proval.  Routine  vital  sign  and  ECG  data  sourced  from  Propaq  206  patient 
monitors  (Welch-Allyn,  Beaverton,  OR)  were  acquired  from  adult  (age 
>  18  years)  trauma  patients  en  route  to  level  1  trauma  centers  and  ulti¬ 
mately  archived  in  our  database.  Additional  clinical  data,  including  de¬ 
mographics,  injury  descriptions,  prehospital  interventions,  hospital 
treatments,  etc.,  were  obtained  via  retrospective  chart  review. 

We  studied  all  subjects  with  at  least  1  reliable  measurement  of  each 
investigational  metric,  allowing  for  a  meaningful  comparison  of  the 
investigational  metrics  (see  below  for  definition  of  measurement  reli¬ 
ability).  Subjects  who  died  before  hospital  admission  were  excluded 
because  it  was  difficult  to  determine  what  volume  of  blood  transfusion 
they  would  have  received  within  24  hours  (or,  in  some  cases,  whether 
they  were  truly  bleeding  or  not).  For  the  primary  analysis,  we  excluded 
patients  who  received  PRBC  transfusion  but  lacked  explicitly  hemor¬ 
rhagic  injuries,  that  is,  no  documented  solid  organ  injury,  no  thoracic 
or  abdominal  hematoma,  and  no  vascular  injury  requiring  a  procedure 
for  hemostasis.  (We  reexamined  these  patients  in  a  secondary  sensitiv¬ 
ity  analysis  to  determine  whether  the  major  findings  of  the  primary 
analysis  were  different  for  the  excluded  population.) 

2.2.  Routine  vital  signs 

We  studied  the  average  of  reliable  vital  signs  (heart  rate  [HR],  respira¬ 
tory  rate  [RR],  systolic  blood  pressure  [SBP],  and  pulse  pressure  [PP  =  SBP 
—  diastolic  blood  pressure])  measured  up  to  the  15th  minute  of  each 
subject's  prehospital  data  record.  The  reliability  of  each  vital  sign  was  de¬ 
termined  using  automated  computer  algorithms  [21 -23].  The  HR  reliabil¬ 
ity  algorithm  [23]  evaluated  whether  the  ECG  waveform  was  clean, 
whether  the  heart  rhythm  was  regular,  and  whether  the  Propaq  HR  was 
close  in  value  to  the  algorithm’s  independent  computation  of  HR.  The  RR 
reliability  algorithm  [21  ]  evaluated  whether  the  impedance  pneumogram 
waveform  was  clean,  whether  the  breaths  were  regular,  and  whether  the 
Propaq  RR  was  close  in  value  to  the  algorithm's  independent  computation 
of  RR.  The  blood  pressure  reliability  algorithm  [22]  evaluated  whether  the 
relationship  between  SBP,  mean  arterial  pressure,  and  diastolic  blood 
pressure  was  normative  and  whether  the  HR  measured  from  the 
oscillometric  cuff  was  close  to  the  HR  measured  by  the  ECG. 

2.3.  Heart  rate  variability  metrics 

We  studied  the  average  value  of  3  reliable  HRV  metrics  (SD  of  the  RRIs 
in  the  ECG  signal  [SDNN],  sample  entropy  [SampEn],  and  rate  of  sinus 
arrhythmia  [RSA])  measured  up  to  the  15th  minute  of  each  subject's 
prehospital  data  record.  SDNN  [8-11]  and  SampEn  [2-4,6,8,10,12]  have 
been  investigated  in  recent  reports,  whereas  RSA  offered  encouraging 
performance  in  prior  exploratory  analysis. 

To  compute  SDNN,  we  upsampled  each  ECG  segment  to  2000  Hz  by 
cubic  spline  interpolation  and  identified  the  location  of  each  R-wave 
using  an  HR  estimation  algorithm  [23],  We  computed  the  difference 
between  successive  R-waves,  which  established  the  RR1  time  series. 
Fig.  1  shows  examples  of  these  RR1  time  series.  For  every  second  of  ECG 


recorded,  we  computed  SDNN:  the  SD  of  RRIs  from  the  preceding  5 
minutes.  The  computed  SDNN  was  considered  reliable  when  the  preced¬ 
ing  5  minutes  of  ECG  waveforms  were  at  least  80%  clean  and  reliable, 
per  the  ECG  waveform  reliability  algorithm  [23],  We  used  a  5-minute 
window  for  SDNN  calculation  in  accordance  with  consensus  guidelines 
[24].  When  the  change  in  RRI  from  one  beat  to  the  next  was  too  large  or 
too  small  (as  per  the  quantitative  criteria  of  Malik  et  al  [25]),  that  beat 
was  considered  aberrant.  R-R  intervals  from  the  interval  immediately 
before  or  immediately  after  the  aberrant  beat  were  excluded  whenever 
SDNN  was  computed. 

To  compute  SampEn,  which  is  a  measure  of  similarity  within  the  RRI 
time  series,  we  used  the  PhysioTools  software  “sampen.m"  [26],  which 
implements  the  method  of  Richman  and  Moorman  [27],  Sample  entro¬ 
py  is  the  probability  that,  if  an  RRI  time  series  has  a  repeated  “similar” 
pattern  of  data  points  of  length  m  (where  m  <k  N),  then  the  similarity 
will  also  persist  when  the  length  of  data  points  is  extended  to  m  +  1. 
Similarity  is  defined  mathematically,  that  is,  when  any  2  sequences  of 
data  points  have  the  same  data  point  values  in  the  same  order  within 
some  tolerance  r.  A  detailed  explanation  of  this  calculation  can  be 
found  in  the  online  PhysioTools  tutorial  [28].  In  this  work,  for  eveiy  sec¬ 
ond  of  ECG  recorded,  we  computed  SampEn  from  the  preceding  200 
ECG  beats  (equivalent  to  N  =  201 ),  using  r  =  0.20  times  the  SD  of  the 
RRI  series,  and  m  =  2.  The  computed  SampEn  values  were  considered 
reliable  only  if  all  the  200  ECG  beats  were  reliable  (as  per  the  ECG  wave¬ 
form  reliability  algorithm  [23])  and  without  any  aberrant  beats  (defined 
above).  The  values  of  N,  m,  and  r  were  selected  in  accordance  with  sev¬ 
eral  recent  reports  evaluating  SampEn  in  trauma  patients  [3,10,12]. 

Lastly,  we  computed  RSA,  which  is  the  frequency  of  oscillation  of  the 
HR  (HR  typically  varies  in  a  rhythmic  fashion,  often  synchronized  to  the 
rate  of  respiration  [29],  although  sometimes  faster  [30]  or  slower  [31  ] 
than  respiration).  Fig.  1  shows  examples  of  the  oscillatory  RSA.  For  com¬ 
putational  purposes,  we  treated  the  RRI  time  series  as  a  form  of  respira¬ 
tory  waveform  [29]  and  applied  our  previously  developed  RR 
measurement  and  reliability  algorithms  [21  j  to  compute  RSA  for  eveiy 
second  and  to  determine  whether  the  waveform  was  reliable  or  not. 

2.4.  Univariate  analysis 

We  analyzed  the  association  between  each  investigational  metric  (HR, 
RR,  SBP,  PP,  SDNN,  SampEn,  and  RSA)  vs  PRBC  transfusion  received  over 
24  hours.  Specifically,  we  computed  the  area  under  the  receiver  operating 
characteristic  curve  (ROC  AUC)  for  each  investigational  metric  as  a  predic¬ 
tor  of  different  24-hour  PRBC  volumes  (24-hour  PRBC  vol:  >  1 ,  >  5,  and  >  9 
units).  We  compared  each  of  the  HRV  metrics  (SDNN,  SampEn,  and  RSA)  vs 
routine  vital  signs  (HR,  RR,  SBP,  and  PP),  testing  whether  there  were  any 
differences  per  DeLong's  test  [32]  with  a  significance  threshold  of  P  <  .05. 

2.5.  Multivariate  analysis 

We  conducted  multivariate  logistic  regression  analysis  using  the 
“glmfit"  routine  in  MATLAB  version  7  (The  Mathworks,  Inc,  Natick, 
MA).  First,  we  evaluated  a  baseline  multivariate  model  containing  all 
routine  vital  signs  (core  feature  set:  HR,  RR,  SBP,  and  PP)  and  compared 
this  model  vs  other  models  that  included  an  HRV  metric  and/or  lacked 
one  of  the  routine  vital  signs.  For  each  model,  we  determined  which 
input  parameters  were  statistically  significant,  and  we  computed  ROC 
AUCs  for  the  same  outcomes  as  the  univariate  analysis  (ie,  >1,  >5, 
and  >  9  units  of  24-hour  PRBC  vol). 

2.6.  Net  reclassification  improvement 

We  tested  whether  the  HRV  metrics  were  associated  with  a  signifi¬ 
cant  net  reclassification  improvement  (NRI),  using  the  statistical  meth¬ 
od  of  Pencina  et  al  [33],  First,  we  computed  the  probability  of 
hemorrhage  given  pairs  of  logistic  regression  models  (baseline  model 
with  different  combinations  of  routine  vital  signs  vs  a  model  with  the 
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same  set  of  vital  signs  plus  an  HRV  metric)  for  the  same  outcomes  as  the 
univariate  analysis  (ie,  >1,  >5,  and  >9  units  of  24-hour  PRBC  vol).  For 
each  subject,  we  assessed  which  model  gave  an  “improved  classifica¬ 
tion”  (defined  as  a  higher  probability  of  hemorrhage  in  hemorrhage  pa¬ 
tients  or  a  lower  probability  of  hemorrhage  in  control  patients).  Then 
we  evaluated  whether  one  model  was  significantly  different  from  the 
other  using  the  z-test  (the  null  hypothesis  was  that  each  model  had 
an  equal  likelihood  of  improved  classification). 

2.7.  Sensitivity  analysis 

Many  subjects  were  excluded  from  the  primary  analyses  because 
they  lacked  a  complete  set  of  reliable  investigational  metrics  within 
their  prehospital  physiological  data.  To  check  whether  this  led  to  nota¬ 
ble  selection  bias,  we  repeated  the  univariate  analysis  on  a  broader  set 
of  subjects  to  determine  whether  the  univariate  findings  were  sensitive 
to  the  exclusion  criteria.  For  each  investigational  metric,  we  identified 
all  subjects  with  at  least  1  reliable  value  (subjects  who  did  not  necessar¬ 
ily  have  a  complete  set  of  reliable  investigational  metrics).  We  then 
computed  the  univariate  ROC  AUC  of  each  metric  for  these  larger  popu¬ 
lations  to  predict  24-hour  PRBC  vol  ( ie,  >  1 ,  >  5,  and  >  9  units  of  24-hour 
PRBC  vol).  However,  we  could  not  perform  paired  comparisons  of 
these  ROC  AUCs  because  each  result  arose  from  somewhat  different 
subject  subsets. 

In  addition,  we  repeated  the  multivariate  analysis  for  our  2  popula¬ 
tions,  MHLF  and  BMF.  For  each,  we  computed  the  ROC  AUC  for  the 
core  feature  set  (HR,  RR,  SBP,  and  PP)  with  and  without  the  investiga¬ 
tional  HRV  metrics:  SDNN,  SampEn,  and  RSA. 

We  also  repeated  the  univariate  and  multivariate  analyses  for  an  alter¬ 
native  outcome,  namely,  subjects  who  received  24-hour  PRBC  vol  greater 
than  or  equal  to  1,  greater  than  or  equal  to  5,  and  greater  than  or  equal  to 
9  units  and  did  not  necessarily  have  explicitly  hemorrhagic  injuries. 

3.  Results 

We  had  a  total  of  999  patients  in  the  overall  database  (subjects  with 
at  least  1  routine  vital  sign  from  the  Propaq  206  monitors),  from  which 
402  patients  composed  the  primary  study  population.  We  excluded 
the  following: 


1.  43  patients  in  whom  the  presence  and  extent  of  hemorrhagic  injury 
was  unknowable  because  of  death  during  transport  or  before  being 
admitted  to  the  hospital, 

2.  90  patients  who  received  PRBC  transfusion  without  an  explicitly 
hemorrhagic  injury  (these  90  patients  were  reincluded  and  analyzed 
in  the  sensitivity  analysis),  and 

3.  464  patients  in  whom  a  paired  comparison  could  not  be  performed 
because  the  patients  lacked  a  complete  set  of  all  vital  signs  during 
their  initial  15  minutes  of  transport  (these  464  patients  were 
reincluded  and  analyzed  in  the  sensitivity  analysis). 

Table  1  shows  the  overall  database  and  the  study  population  charac¬ 
teristics.  Most  of  the  differences  between  the  overall  database  and  the 
study  population  were  minor,  except  for  a  slightly  higher  overall  mor¬ 
tality  rate  in  the  overall  database. 

Fig.  2  displays  the  distributions  of  all  investigational  metrics  (also  see 
Table  A.1 ).  Table  2  reports  the  univariate  ROC  AUCs  of  the  basic  vital 
signs  and  investigational  HRV  metrics  for  the  identification  of  24-hour 
PRBC  vol  greater  than  or  equal  to  1 ,  greater  than  or  equal  to  5,  and  greater 
than  or  equal  to  9  units.  We  observed  that  both  the  HRV  metrics  (ROC 
AUCs,  0.60-0.79)  and  routine  vital  signs  (ROC  AUCs,  0.65-0.79)  had  sta¬ 
tistically  significant  discriminatory  power,  but  none  of  the  3  HRV  metrics 
were  significantly  superior  to  any  of  the  routine  vital  signs. 

Of  the  investigational  HRV  metrics,  RSA  yielded  the  highest  univari¬ 
ate  ROC  AUCs.  Table  3  shows  the  multivariate  analysis  testing  whether 
RSA  provided  significant  independent  information  above  and  beyond 
routine  vital  signs.  When  added  to  multivariate  logistic  regression 
models  that  included  the  core  feature  set  (and  subsets  of  the  core  fea¬ 
ture  set),  RSA  was  found  to  be  a  significant,  independent  predictor  of 
24-hour  PRBC  transfusion.  However,  the  resultant  improvements  in 
ROC  AUCs  when  RSA  was  added  to  the  core  feature  set,  and  its  subsets 
were  minor,  and  neither  improvements  in  ROC  AUCs  nor  NRIs  were  sta¬ 
tistically  significant. 

We  also  performed  the  same  multivariate  analysis  using  SDNN  and 
SampEn  (with  the  same  feature  sets  listed  in  the  first  column  of 
Table  3,  but  using  SDNN  and  SampEn  in  place  of  RSA).  We  found  that 
SDNN  was  a  significant,  independent  predictor  of  PRBC  transfusions 
only  in  the  model  that  consisted  of  RR,  SBP,  PP,  and  SDNN.  Similarly, 
SampEn  was  a  significant,  independent  predictor  of  PRBC  transfusion 
only  in  the  model  that  consisted  of  RR,  SBP,  PP,  and  SampEn.  When 


Table  1 

Characteristics  of  the  overall  database  and  the  study  population 


Overall  database 

Study  population 

MHLF 

BMF 

MHLF 

BMF 

Population,  n 

757 

242 

273 

129 

Male,  n  (%) 

562  (74%) 

179  (74%) 

207  (76%) 

97  (75%) 

Female,  n  (%) 

195 (26%) 

63  (26%) 

66  (24%) 

32  (25%) 

Age,  years,  mean  (SD)a 

Mechanism  of  injury 

38  (15) 

47(21) 

37(14) 

43  (19) 

Blunt,  n  (%) 

664  (88%) 

216  (89%) 

238 (87%) 

118  (92%) 

Penetrating,  n  (%) 

84(11%) 

26(11%) 

30(11%) 

11  (9%) 

Hospital  transfer,  n  (%) 

0  (0%) 

118(49%) 

0(0%) 

65  (50%) 

Prehospital  airway  intubation,  n  (%) 

165 (22%) 

97  (40%) 

52  (19%) 

51  (40%) 

ISS,  median  (IQR)b 

17  (9-34) 

17  (9-26) 

13  (8-34) 

17  (9-26) 

Prehospital  GCS,  median  (IQR)C 

15  (12-15) 

15  (6-15) 

15(13-15) 

15  (5-15) 

Prehospital  fluid  volume,  mL,  median  (lQR)d 

24-h  PRBC  transfusion  volumes 

300  (100-628) 

100  (50-250) 

300  (100-600) 

100  (50-200) 

24-h  PRBC  vol  >1  unit,  n  (35) 

153  (20%) 

62  (26%) 

38  (14%) 

16  (12%) 

24-h  PRBC  vol  >9  units,  n  (%) 

36  (5%) 

11  (5%) 

11  (4%) 

5  (4%) 

Overall  mortality,  n  (%) 

85  (11%) 

28 (12%) 

12  (4%) 

9  (7%) 

Died  before  admission  to  ED,  n  (%) 

36 (42%) 

7  (25%) 

0(0%) 

0  (0%) 

Died  after  admission  to  ED,  n  (%) 

49  (58%) 

21  (75%) 

12  (100%) 

9 (100%) 

The  overall  database  consists  of  all  subjects  who  had  at  least  1  available  routine  vital  sign  from  the  Propaq  206  monitor.  See  text  for  details  about  the  study  population.  Abbreviations:  GCS, 
Glasgow  Coma  Scale;  IQR,  interquartile  range;  ISS,  injury  severity  score. 
a  No  age  information  available  for  6  patients  in  the  overall  database  and  3  patients  in  the  study  population. 
b  No  injury  severity  score  information  available  for  186  patients  in  the  overall  database  and  64  patients  in  the  study  population. 
c  No  Glasgow  Coma  Scale  information  available  for  75  patients  in  the  overall  database  and  29  patients  in  the  study  population. 
d  No  prehospital  fluid  volume  information  available  for  36  patients  in  the  overall  database  and  17  patients  in  the  study  population. 
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24-hr  PRBC  volume 


Population 
(Controls,  Cases): 


402  (348,  54) 


HR 

(bpm) 


RR 

(cpm) 


SBP 

(mmHg) 


PP 

(mmHg) 


SDNN 

(ms) 


SampEn 


RSA 

(cpm) 


402  (377,  25) 


<9  ■  >  9 

402(386, 16) 


Fig.  2.  Distributions  of  routine  vital  signs  and  HRV  metrics  for  trauma  patients  grouped  by  different  24-hour  PRBC  volumes.  The  medians  and  interquartile  ranges  of  the  distributions  are 
provided  in  Table  A.l. 


SDNN  and  SampEn  were  separately  added  to  the  multivariate  models 
together  with  the  core  feature  set  (or  subsets  of  the  core  feature  set), 
the  resultant  improvements  in  ROC  AUCs  were  minor  (  +  0.03  or 
lesser),  and  neither  improvements  in  ROC  AUCs  nor  NRIs  were 
statistically  significant. 


Table  2 

Areas  under  the  receiver  operating  characteristic  curves  and  95%  confidence  intervals  of 
routine  vital  signs  and  HRV  metrics  (univariate  performance)  for  predicting  24-hour 
PRBC  volume 


24-h  PRBC  volume 

Features 

>1 

>5 

>9 

Population  (controls, 
cases) 

402  (348,  54) 

402  (377,25) 

402  (386, 16) 

Routine  vital  signs 


HR 

0.68  (0.59-0.76) 

0.74  (0.59-0.84) 

0.72 

(0.53-0.85) 

RR 

0.65  (0.56-0.73) 

0.74  (0.63-0.83) 

0.73 

(0.53-0.84) 

SBP 

0.70  (0.61-0.78) 

0.72  (0.58-0.82) 

0.73 

(0.55-0.86) 

PP 

HRV  metrics 

0.74(0.65-0.81) 

0.79  (0.68-0.88) 

0.79 

(0.61-0.90) 

SDNN 

0.67  (0.59-0.75) 

0.72  (0.61-0.82) 

0.71 

(0.57-0.82) 

SampEn 

0.60  (0.53-0.68)3 

0.63  (0.52-0.73)3 

0.62 

(0.46-0.75) 

RSA 

0.72  (0.64-0.79) 

0.76  (0.62-0.85) 

0.79 

(0.64-0.89) 

The  3  HRV  metrics  are  compared  to  each  of  the  routine  vital  signs  for  significant  differ¬ 
ences  (P<  .05)  using  DeLong's  test. 

a  Area  under  the  receiver  operating  characteristic  curves  is  significantly  different  from 
the  PP  ROC  AUC. 


Table  3 

Areas  under  the  receiver  operating  characteristic  curves  and  95%  confidence  intervals  of 
the  multivariate  logistic  regression  models  consisting  of  different  combinations  of  routine 
vital  signs  and  rate  of  sinus  arrhythmia  for  predicting  24-hour  PRBC  volume 


24-h  PRBC  volume 

Feature  set  description  (features) 

>1 

>5 

>9 

Population  (controls,  cases) 

402  (348,  54) 

402  (377,  25) 

402  (386, 16) 

Core  feature  set 

0.79 

0.85 

0.86 

(HRa,  RRa,  SBP,  PP) 

(0.70-0.85) 

(0.73-0.92) 

(0.73-0.94) 

Core  feature  set  +  RSA 

+  0.00 

+  0.01 

+  0.02 

(HR,  RRa,  SBP,  PP,  RSAa) 

Core  feature  set  —  HR 

+  0.00 

+  0.01 

+  0.00 

(RRa,  SBP,  PPa) 

Core  feature  set  —  HR  +  RSA 

+  0.00 

+  0.01 

+  0.02 

(RRa,  SBP,  PP,  RSAa) 

Core  feature  set  —  RR 

-0.02 

-0.03 

-0.05 

(HRa,  SBP,  PP) 

Core  feature  set  —  RR  +  RSA 

+  0.00 

-0.01 

+  0.00 

(HR,  SBP,  PP,  RSAa) 

Core  feature  set  —  (SBP,  PP) 

-0.10b 

—  0.07b 

-0.09 

(HRa,  RRa) 

Core  feature  set  —  (SBP,  PP)  +  RSA 

-0.06 

—  0.07b 

-0.05 

(HR,  RRa,  RSAa) 

The  bold  numbers  in  the  first  row  show  the  performance  of  the  core  feature  set  in  terms  of 
ROC  AUCs  and  the  95%  confidence  intervals.  The  subsequent  rows  represent  the  relative 
change  in  ROC  AUC  with  respect  to  that  of  the  core  feature  set. 

Note:  Findings  for  the  SDNN  and  SampEn  were  similar;  see  Results  section  for  details. 

a  The  coefficient  of  the  corresponding  feature  is  significantly  different  from  zero  (P  <  .05) 
in  at  least  1  of  the  models  for  predicting  24-hour  PRBC  volume  greater  than  or  equal  to  1, 
greater  than  or  equal  to  5,  or  greater  than  or  equal  to  9  units. 

b  Area  under  the  receiver  operating  characteristic  curves  is  significantly  different  (P  <  .05) 
from  the  core  feature  set  ROC  AUC  by  DeLong's  test. 
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3.1.  Sensitivity  analysis 

We  performed  several  sensitivity  analyses,  to  test  whether  our  ex¬ 
clusion  criteria  affected  our  findings.  Here,  we  summarize  the  findings 
(detailed  results  are  provided  in  Appendix  A  under  Sensitivity  analysis ). 

We  repeated  the  univariate  analysis  on  a  broader  set  of  subjects  (sub¬ 
jects  who  did  not  necessarily  have  a  complete  set  of  reliable  vital  signs 
and  HRV  metrics).  Compared  with  the  primary  results  (ie,  Table  2), 
there  were  neither  any  significant  changes  nor  notable  trends. 

We  repeated  the  primary  multivariate  analysis  for  2  subpopulations 
(MHLF  vs  BMF)  for  greater  than  or  equal  to  1,  greater  than  or  equal  to  5, 
and  greater  than  or  equal  to  9  units  of  24-hour  PRBC  vol.  When  we 
added  RSA  to  the  core  feature  set  (SBP,  PP,  HR,  and  RR),  respective  in¬ 
creases  in  ROC  AUCs  were  +  0.00,  +  0.00,  and  +  0.02  in  MHLF  and 
+  0.01,  +0.05,  and  +0.03  in  BMF.  When  we  added  SDNN  to  the  core 
feature  set,  respective  increases  in  ROC  AUCs  were  +0.00,  +0.01,  and 
+  0.00  in  MHLF  and  +0.00,  +0.01,  and  +0.01  in  BMF.  When  we  added 
SampEn  to  the  core  feature  set,  respective  increases  in  ROC  AUC  were 
+  0.00,  +0.00,  and  +0.00  in  MHLF  and  +0.00,  +0.03,  and  +0.00  in 
BMF.  Overall,  increases  in  ROC  AUCs  were  very  similar  in  MHLF  vs  BMF. 

We  also  repeated  the  primary  analysis  with  an  alternative  outcome 
definition:  subjects  who  received  PRBC  transfusions  whether  they  had 
explicitly  hemorrhagic  injuries.  As  in  the  primary  analysis  (ie,  Table  3), 
improvements  in  the  ROC  AUCs  were  minimal  after  adding  RSA, 
SampEn,  or  SDNN  to  the  core  feature  set  or  its  subsets  (ROC  AUC 
improvements  were  +0.02  or  less). 

4.  Discussion 

After  a  life-threatening  injury,  some  trauma  casualties  may  tempo¬ 
rarily  evidence  normal  vital  signs,  belying  the  severity  of  their  condition. 
This  motivated  the  substantial  interest  in  HRV  metrics  as  indexes  of  car¬ 
diovascular  stability  for  trauma  patients,  to  better  distinguish  between 
patients  who  require  time-sensitive  interventions  vs  those  with  less 
acute  conditions. 

Our  analysis  of  prehospital  vital  signs  demonstrated  that  before  hos¬ 
pital  arrival,  many  patients  with  substantial  bleeding  (defined  by  a  large 
24-hour  PRBC  vol)  had  abnormal  vital  signs  consistent  with  hypovole¬ 
mia:  tachycardia,  tachypnea,  reduced  SBP,  and  reduced  PP  (ie,  reduced 
stroke  volume).  Multivariate  analysis  allowed  for  very  good  separation 
between  patients  with  and  without  substantial  bleeding  (ie,  ROC  AUC, 
0.86  in  Table  3).  Heart  rate  variability  metrics  of  autonomic  tone  were 
also  significantly  different  from  controls  in  many  patients  with  substan¬ 
tial  hemorrhage.  However,  when  combined  with  routine  vital  signs, 
HRV  added  negligible  additional  discriminatory  value  (see  Table  3). 
This  finding  may  indicate  that  discriminatory  changes  in  HRV  and 
changes  in  standard  vital  signs  develop  at  similar  stages  during  progres¬ 
sive  hemorrhage. 

In  theory,  there  should  be  compensatory  changes  in  the  autonomic 
system  during  the  very  earliest  stages  of  the  response  to  serious  injuiy. 
Indeed,  population  averages  of  HRV  indexes  have  been  shown  to  corre¬ 
late  with  central  blood  volume  loss  in  animal  hemorrhage  experiments 
[34]  and  hypovolemia  in  human  lower  body  negative-pressure  studies 
[13,35-37].  Clinically,  significant  group  differences  in  HRV  metrics 
have  been  reported  between  trauma  patients  who  require  LSIs  and 
those  who  do  not  [4,6,8,12]  and  between  survivors  and  fatalities 
[2, 3, 5,7].  in  terms  of  discriminatory  power,  our  own  findings  suggest 
that  HRV  metrics  are  comparable  to  routine  vital  signs,  in  terms  of 
their  possible  utility  for  identifying  substantial  bleeding. 

At  the  same  time,  there  are  physiological  reasons  why  HRV  metrics 
might  not  add  discriminatory  value  above  and  beyond  routine  vital 
signs.  First  of  all,  vital  signs  include  HR,  which  alone  provides  some 
basic  measure  of  the  autonomic  system;  that  is,  tachycardia  represents 
sympathetic  activation,  whereas  bradycardia  represents  parasympa¬ 
thetic  dominance.  Although  HRV  metrics  represent  a  more  nuanced 
quantification  of  the  sympathetic  and  parasympathetic  states,  it  is 


worth  noting  that  the  autonomic  system  is  highly  sensitive  to  physio¬ 
logic  stimuli.  For  instance,  performing  mental  arithmetic  has  been 
shown  to  alter  HRV  metrics  [38].  In  theory,  such  sensitivity  to  disparate 
stimuli  might  confound  the  association  between  HRV  and  hemorrhage. 
Previous  studies  suggest  that  the  complexity  of  interindividual  and 
intraindividual  variability  in  autonomic  compensatory  responses 
weakens  the  association  between  HRV  metrics  and  blood  loss  and 
weakens  their  potential  diagnostic  value  [13]. 

In  terms  of  specific  HRV  metrics,  we  studied  2,  which  have  been  the 
focus  of  other  trauma  reports:  SDNN  [8-1 1  ]  and  SampEn  [2-4,6,8,10,12]. 
We  also  studied  RSA,  which  we  previously  found  offered  encouraging 
performance.  Ectopic  beats,  transient  events  (ie,  nonstationary  signal), 
motion  artifacts,  and  length  of  data  acquisition  are  technical  factors 
that  can  affect  these  HRV  calculations  [6,37],  and  we  used  previously 
validated  algorithms  [23]  to  exclude  unreliable  segments  of  ECG  (ie,  ei¬ 
ther  noisy  or  with  ectopic  beats).  Note  that  we  did  not  study  frequency 
domain  metrics,  which  are  less  robust  to  some  of  the  aforementioned 
factors  affecting  HRV  calculations  and  are  likely  impractical  for  trauma 
patient  monitoring  [24,34,39], 

It  is  worth  noting  that  time  averaging  of  HRV  and  vital  signs,  as  we 
did  in  our  analysis,  reduced  the  effects  of  temporal  variability  and, 
therefore,  may  have  increased  overall  diagnostic  performance  [40]. 
Time  averaging  likely  represents  a  “best  case”  for  vital  signs  and  HRV 
metrics  because,  in  practice,  clinicians  do  not  use  time-averaged  param¬ 
eters,  and  episodic  fluctuations  can  result  in  misleading  vital  sign  pat¬ 
terns  [41].  As  a  point  of  comparison,  Zarzaur  et  al  [42]  reported  that  a 
single  isolated  measurement  of  SBP  and  HR  (ie,  the  Shock  Index) 
yielded  an  ROC  AUC  of  0.78  for  predicting  greater  than  or  equal  to  4 
units  of  blood  in  48  hours.  Moreover,  there  is  room  for  improvement: 
at  the  90%  sensitivity  operating  point  of  our  receiver  operating  charac¬ 
teristic  curve  for  vital  signs  alone  (multivariate  model  using  HR,  RR, 
SBP,  and  PP),  specificity  was  only  40%. 

In  terms  of  limitations,  it  is  possible  that  HRV  may  be  valuable  for 
other  clinical  applications  or  that  our  findings  may  not  be  generalizable 
to  alternative  HRV  metrics  (beyond  those  studied  in  this  report).  How¬ 
ever,  our  study  design,  whereby  HRV  metrics  were  directly  compared  to 
routine  clinical  data  for  assessing  diagnostic  thinking  efficacy,  remains 
relevant,  with  the  potential  to  enhance  future  HRV  investigations.  Sec¬ 
ond,  HRV  metrics  can  be  affected  by  disparate  factors  [38],  and  it  is  pos¬ 
sible  that  another  data  set  may  offer  significantly  different  findings. 
However,  inconsistent  findings  in  different  data  sets,  due  to  HRV’s 
established  sensitivity  to  confounding  effects,  would  be  another  reason 
for  caution  about  HRV  in  trauma  care. 

There  are  2  primary  implications  of  this  research.  First,  from  a  clinical 
standpoint,  our  findings  do  not  support  that  HRV  metrics  add  value  over 
routine  vital  signs,  in  terms  of  prehospital  identification  of  substantial 
bleeding.  Given  a  multivariate  regression  model,  the  HRV  metrics 
added  negligible  diagnostic  value.  Moreover,  clinicians  are  unlikely  to 
weigh  the  information  from  HRV  as  carefully  as  this  multivariate 
model,  and  there  is  some  theoretical  risk  to  having  incorrect  decision 
making,  that  is,  some  clinicians  might  be  overreliant  on  HRV  metrics 
rather  than  routine  vital  signs. 

The  second  implication  relates  to  research  methodology.  By  way 
of  background,  Pearl  [43]  described  a  7-tier  hierarchical  approach 
to  evaluating  diagnostic  testing.  The  type  of  analysis  in  the  current 
report— directly  comparing  HRV  to  routine  vital  signs— corresponds 
to  Pearl’s  third  tier  “diagnostic  thinking  efficacy,”  which  includes 
the  “percentage  of  cases  in  which  the  final  diagnosis  changed  after 
testing."  What  is  notable  among  HRV  clinical  investigation  is  a  scar¬ 
city  of  comparisons  against  standard  criteria  for  decision  making, 
for  example,  standard  criteria  for  trauma  center  transport  [14]  or 
standard  criteria  for  neuroimaging  after  head  injury  [15],  Arguably, 
there  would  be  a  better  understanding  of  the  appropriate  role  of 
HRV  in  clinical  medicine  if  a  larger  proportion  of  the  10000  HRV  ci¬ 
tations  currently  listed  by  PubMed  focused  on  Pearl’s  third  or  higher 
tiers  of  evaluation. 
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5.  Conclusions 

We  investigated  whether  HRV  was  useful  for  the  identification  of 
trauma  patients  who  require  blood  transfusion.  Heart  rate  variability 
metrics  were  comparable  to  routine  vital  signs  in  univariate  analysis. 
However,  in  multivariate  analysis,  HRV  metrics  did  not  significantly  im¬ 
prove  diagnostic  performance.  Our  findings  do  not  support  that  HRV 
would  improve  today's  standard  care  for  this  clinical  application. 


Appendix  A.  Sensitivity  analysis 

We  repeated  the  univariate  analysis  on  a  broader  set  of  subjects 
(subjects  who  did  not  necessarily  have  a  complete  set  of  reliable  vital 
signs  and  HRV  metrics).  Table  A.2  shows  the  results.  The  ROC  AUCs  in 
this  secondary  population  were  similar  to  the  primary  analysis  in 
terms  of  the  relative  performance  of  the  HRV  metrics  vs  routine  vital 
signs.  There  were  neither  any  significant  changes  nor  notable  trends. 
All  ROC  AUCs  for  this  secondary  analysis  were  within  the  95%  confi¬ 
dence  intervals  of  the  primary  analysis  (see  Table  2). 

We  also  repeated  the  primary  analysis  with  an  alternative  out¬ 
come  definition:  subjects  who  received  PRBC  transfusions  whether 
they  had  explicitly  hemorrhagic  injuries.  As  before,  we  excluded 
the  subjects  who  died  during  transport  and  those  who  did  not  have 
reliable  investigational  metrics.  The  findings  were  similar  to  the 
primary  analysis,  with  all  the  ROC  AUCs  within  the  95%  confidence 
intervals  of  the  primary  analysis  with  the  following  exceptions:  the 
ROC  AUC  corresponding  to  RR  for  the  prediction  of  24-hour  PRBC 
vol  greater  than  or  equal  to  1  unit  was  0.54;  the  ROC  AUC  corre¬ 
sponding  to  RSA  for  predicting  24-hour  PRBC  vol  greater  than  or 
equal  to  1  unit  was  0.63.  As  in  the  primary  analysis,  none  of  the 
HRV  metrics  were  significantly  better  as  univariate  predictors  of 
24-hour  PRBC  transfusions  than  routine  vital  signs  (with  one 
exception:  RSA  was  significantly  superior  to  RR  for  the  prediction 
of  24-hour  PRBC  vol  >1  unit,  but  not  for  >5  or  >9  units). 

As  in  the  primary  multivariate  analysis,  RSA  was  significant  in  all 
multivariate  models  that  included  the  core  feature  set  (and  subsets  of 
the  core  feature  set)  for  predicting  24-hour  PRBC  transfusion.  However, 
SDNN  was  not  a  significant  predictor  of  PRBC  transfusions  in  any  of  the 
multivariate  models.  SampEn  was  significant  when  included  in  the 
model  that  consisted  of  RR,  SBP,  and  PP  as  in  the  primary  analysis  and 
in  the  model  that  consisted  of  the  core  feature  set,  unlike  the  primary 
analysis.  Regardless,  improvements  in  the  aforementioned  ROC  AUCs 
were  minimal  after  adding  RSA,  SDNN,  or  SampEn  to  the  core  feature 
set  or  its  subsets  (ROC  AUC  improvement  was  +  0.03  or  less). 


Table  A.2 

Areas  under  the  receiver  operating  characteristic  curves  and  95%  confidence  intervals  of 
routine  vital  signs  and  heart  rate  variability  metrics  for  predicting  24-hour  packed  red 
blood  cell  volume 


Features 

24-h  PRBC  volume 

>1 

>5 

>9 

Population  (controls,  cases) 

797 

(698,  99) 

797 

(749,  48) 

797 

(765,  32) 

HR 

0.66 

(0.60-0.72) 

0.71 

(0.61-0.79) 

0.70 

(0.58-0.80) 

Population  (controls,  cases) 

508 

(439,  69) 

508 

(474,  34) 

508 

(484,  24) 

RR 

0.61 

(0.53-0.69) 

0.66 

(0.55-0.75) 

0.65 

(0.52-0.76) 

Population  (controls,  cases) 

837 

(736, 101) 

837 

(788,  49) 

837 

(808,  29) 

SBP 

0.75 

(0.69-0.80) 

0.78 

(0.70-0.84) 

0.76 

(0.65-0.84) 

Population  (controls,  cases) 

837 

(736, 101) 

837 

(788,  49) 

837 

(808,  29) 

PP 

0.76 

(0.70-0.81) 

0.81 

(0.73-0.87) 

0.79 

(0.68-0.87) 

Population  (controls,  cases) 

563 

(488,  75) 

563 

(528,  35) 

563 

(540,  23) 

SDNN 

0.66 

(0.59-0.73) 

0.67 

(0.56-0.76) 

0.61 

(0.47-0.74) 

Population  (controls,  cases) 

522 

(453,  69) 

522 

(490,  32) 

522 

(502,  20) 

SampEn 

0.58 

(0.51-0.65) 

0.62 

(0.52-0.72) 

0.65 

(0.50-0.77) 

Population  (controls,  cases) 

668 

(579,  89) 

668 

(626,  42) 

668 

(641,27) 

RSA 

0.72 

(0.65-0.77) 

0.75 

(0.66-0.82) 

0.78 

(0.68-0.86) 

Shown  above  are  the  univariate  performance  results  for  a  secondary  sensitivity  analysis 
using  less  restrictive  inclusion  criteria:  subjects  with  at  least  1  reliable  value  for  each  inves¬ 
tigational  metric.  Unlike  the  primary  study  population,  this  population  did  not  necessarily 
have  a  full  set  of  every  reliable  investigational  metric.  Abbreviations:  HR,  heart  rate;  PP, 
pulse  pressure  =  systolic  blood  pressure  (SBP)  —  diastolic  blood  pressure;  PRBC,  packed 
red  blood  cells;  RR,  respiratory  rate;  RSA,  rate  of  sinus  arrhythmia;  SampEn,  sample 
entropy;  SDNN,  SD  of  the  normal  R-R  intervals  in  the  electrocardiogram  signal. 
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sinus  arrhythmia;  SampEn,  sample  entropy;  SDNN,  SD  of  the  normal  R-R  intervals  in  the  electrocardiogram  signal. 
a  No  ISS  information  available  for  64  of  the  402  patients  in  the  study  population. 
b  No  GCS  information  available  for  29  of  the  402  patients  in  the  study  population. 
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